How Bayes factors change scientific practice
نویسنده
چکیده
Bayes factors provide a symmetricalmeasure of evidence for onemodel versus another (e.g. H1 versusH0) in order to relate theory to data. These properties help solve some (but not all) of the problems underlying the credibility crisis in psychology. The symmetry of the measure of evidence means that there can be evidence for H0 just as much as for H1; or the Bayes factor may indicate insufficient evidence either way. P-values cannotmake this three-way distinction. Thus, Bayes factors indicatewhen the data count against a theory (and when they count for nothing); and thus they indicate when replications actually support H0 or H1 (in ways that power cannot). There is every reason to publish evidence supporting the null as going against it, because the evidence can bemeasured to be just as strong either way (thus the published record can be more balanced). Bayes factors can be B-hacked but they mitigate the problem because a) they allow evidence in either direction so people will be less tempted to hack in just one direction; b) as a measure of evidence they are insensitive to the stopping rule; c) families of tests cannot be arbitrarily defined; and d) falsely implying a contrast is planned rather than post hoc becomes irrelevant (though the value of pre-registration is not mitigated). © 2015 Elsevier Inc. All rights reserved.
منابع مشابه
Commentary: How Bayes factors change scientific practice
Citation: Perezgonzalez JD (2016) Commentary: How Bayes factors change scientific practice. A commentary on How Bayes factors change scientific practice by Dienes, Z. Dienes's (2016) article is one of the contributions to the special issue " Bayes factors for testing hypotheses in psychological research... " being published by the Journal of Mathematical Psychology. It is the article most acces...
متن کاملThe philosophy of Bayes factors and the quantification of statistical evidence
A core aspect of science is using data to assess the degree to which data provide evidence for competing claims, hypotheses, or theories. Evidence is by definition something that should change the credibility of a claim in a reasonable person’s mind. However, common statistics, such as significance testing and confidence intervals have no interface with concepts of belief, and thus it is unclea...
متن کاملReply to Rouder (2014): good frequentist properties raise confidence.
Established psychological results have been called into question by demonstrations that statistical significance is easy to achieve, even in the absence of an effect. One often-warned-against practice, choosing when to stop the experiment on the basis of the results, is guaranteed to produce significant results. In response to these demonstrations, Bayes factors have been proposed as an antidot...
متن کاملInvited Commentary Invited Commentary: Evidence-based Evaluation of p Values and Bayes Factors
Despite clear deficiencies of the p value as a summary of statistical evidence, compelling alternatives with strong theoretical justification, such as the Bayes factor and the related likelihood ratio, are rarely presented in epidemiologic publications. Comparison of the historical performance of the p value with that of its competitors in the epidemiologic literature may help epidemiologists e...
متن کاملApproximate Bayesian Model Selection with the Deviance Statistic
Bayesian model selection poses two main challenges: the specification of parameter priors for all models, and the computation of the resulting Bayes factors between models. There is now a large literature on automatic and objective parameter priors in the linear model. One important class are g-priors, which were recently extended from linear to generalized linear models (GLMs). We show that th...
متن کامل